Goto

Collaborating Authors

 identity-related feature




IdenBAT: Disentangled Representation Learning for Identity-Preserved Brain Age Transformation

Maeng, Junyeong, Oh, Kwanseok, Jung, Wonsik, Suk, Heung-Il

arXiv.org Artificial Intelligence

Brain aging represents an intrinsic biological phenomenon marked by discernible morphological changes within the human brain Fjell and Walhovd (2010). In the analysis of brain aging using medical imaging, structural magnetic resonance imaging (sMRI) plays a crucial role as they provide detailed insights into age-related variations and assist in accurate assessments of these alterations. Advances in sMRI-based age transformation have especially allowed researchers and clinicians to visualize and quantify patient-specific intricate brain maturation and degeneration patterns, facilitating medical diagnosis advancements. These capabilities can be pivotal for longitudinal studies to track cognitive or health state progressions over time Cole, Ritchie, Bastin, Hernández, Muñoz Maniega, Royle, Corley, Pattie, Harris, Zhang et al. (2018); Huizinga, Poot, Vernooij, Roshchupkin, Bron, Ikram, Rueckert, Niessen, Klein, Initiative et al. (2018), whereas brain age transformation with preserving patient traits remains a formidable challenge. Because most methods even change characteristics unrelated to aging during the transformation process, the crux lies in modeling the aging process without distorting personal identities intrinsic to each subject Xia, Chartsias, Wang, Tsaftaris, Initiative et al. (2021). When the aging model fails to preserve personal properties regarding identity, it may lead to misinterpretations of age-related changes, potentially compromising the accuracy and reliability of diagnostic decisions. Previous brain age transformation studies Huizinga et al. (2018); Zhang, Shi, Wu, Wang, Yap and Shen (2016); Zhao, Adeli, Honnorat, Leng and Pohl (2019); Lorenzi, Pennec, Frisoni, Ayache, Initiative et al. (2015); Sivera, Delingette, Lorenzi, Pennec, Ayache, Initiative et al. (2019) have often relied on prototype-based strategies that compare averaged brain patterns across different age groups. While these approaches aid in understanding generalized characteristics shared among age groups, they tend to neglect the unique traits of individual subjects. Recently, with the emergence of generative models using longitudinal data Goodfellow, Pouget-Abadie, Mirza, Xu, Warde-Farley, Ozair, Courville and Bengio (2014); Makhzani, Shlens, Jaitly, Goodfellow and Frey (2015), researchers have gained the ability to create more accurate and realistic simulations of brain aging by virtue of the advantages of its data, which comprised MRI scans of the same subject at multiple time points Rachmadi, del C. Valdés-Hernández, Makin,


Disentangled Representations for Short-Term and Long-Term Person Re-Identification

Eom, Chanho, Lee, Wonkyung, Lee, Geon, Ham, Bumsub

arXiv.org Artificial Intelligence

We address the problem of person re-identification (reID), that is, retrieving person images from a large dataset, given a query image of the person of interest. A key challenge is to learn person representations robust to intra-class variations, as different persons could have the same attribute, and persons' appearances look different, e.g., with viewpoint changes. Recent reID methods focus on learning person features discriminative only for a particular factor of variations (e.g., human pose), which also requires corresponding supervisory signals (e.g., pose annotations). To tackle this problem, we propose to factorize person images into identity-related and unrelated features. Identity-related features contain information useful for specifying a particular person (e.g., clothing), while identity-unrelated ones hold other factors (e.g., human pose). To this end, we propose a new generative adversarial network, dubbed identity shuffle GAN (IS-GAN). It disentangles identity-related and unrelated features from person images through an identity-shuffling technique that exploits identification labels alone without any auxiliary supervisory signals. We restrict the distribution of identity-unrelated features or encourage the identity-related and unrelated features to be uncorrelated, facilitating the disentanglement process. Experimental results validate the effectiveness of IS-GAN, showing state-of-the-art performance on standard reID benchmarks, including Market-1501, CUHK03, and DukeMTMC-reID. We further demonstrate the advantages of disentangling person representations on a long-term reID task, setting a new state of the art on a Celeb-reID dataset.